Symplectic Runge-Kutta Schemes for Adjoint Equations, Automatic Differentiation, Optimal Control, and More

The study of the sensitivity of the solution of a system of differential equations with respect to changes in the initial conditions leads to the introduction of an adjoint system, whose discretisation is related to reverse accumulation in automatic differentiation. Similar adjoint systems arise in optimal control and other areas, including classical Mechanics. Adjoint systems are introduced in such a way that they exactly preserve a relevant quadratic invariant (more precisely an inner product). Symplectic Runge-Kutta and Partitioned Runge-Kutta methods are defined through the exact conservation of a differential geometric structure, but may be characterized by the fact that they preserve exactly quadratic invariants of the system being integrated. Therefore the symplecticness (or lack of symplecticness) of a Runge-Kutta or Partitioned Runge-Kutta integrator should be relevant to understand its performance when applied to the computation of sensitivities, to optimal control problems and in other applications requiring the use of adjoint systems. This paper examines the links between symplectic integration and those applications. The article presents in a new, unified way a number of results now scattered or implicit in the literature. In particular we show how some common procedures, such as the direct method in optimal control theory and the computation of sensitivities via reverse accumulation, imply, probably unbeknownst to the user, ‘hidden’ integrations with symplectic Partitioned Runge-Kutta schemes.